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© Method for recording and reproducing data. 



© A header for controlling each data block is dis- 
posed at the beginning of a data unit composed of a 
combination of video data, sound data, and sub- 
picture data. Header data is disposed at the begin- 
ning of each data block to control data in the data 



block. Thus, in particular, when a plurality of chan- 
nels of data and a plurality of streams of data are 
recorded in a data block and one of them is se- 
lected, each channel data and each stream data can 
be properly controlled. 
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The present invention relates to a method for 
constructing data blocks of for example picture 
data and sound data as one data unit, an apparatus 
for reproducing the data block, and a method for 
reproducing the data block. 

In recent years, a moving picture type optical 
disc reproducing apparatus for reproducing such as 
picture data and sound data from an optical disc 
has been developed. Such an apparatus has been 
widely used as for example movie reproducing 
apparatus and Karaoke reproducing apparatus. Re- 
cently, as a data compressing system for moving 
picture data, an MPEG (Moving Picture Image Cod- 
ing Expert Group) system has been employed as 
an international standard. In the MPEG system, 
picture data is compressed with a variable length. 

When a moving picture (main picture), sound, 
superimposed text (sub-picture), and so forth are 
recorded on a recording medium such as an op- 
tical disc, as shown in Fig. 42, each type of data is 
divided into minimum data units (hereinafter re- 
ferred to as DUTs). At the beginning of a set of 
DUTs, a header that represents each DUT is pro- 
vided. The length of each DUT is fixed. The length 
of each DUT of for example a CD-ROM is 2340 
bytes. 

However, when the length of the DUT is fixed, 
dummy data should be placed in DUTs so that the 
data amount of the main picture accords with the 
data amount of the sub-picture. Thus, the redun- 
dancy of the data inevitably increases. To prevent 
such a problem, a system for causing the re- 
producing time period of data of the DUT to be 
constant has been proposed. 

However, when such a system is used, the 
following problems take place. 

In this system, since each DUT has a different 
length, the header should have control information 
that represents at least the start position of each 
DUT and the relation between DUTs so that the 
reproducing apparatus can process the DUTs. 
Such information can be easily provided. In recent 
years, however, a system of which a plurality of 
channels of sound data and sub-picture data are 
recorded on an optical disc has been studied and 
thereby data of the DUTs has been finely con- 
structed. Thus, information of the start position, 
relation, and so forth of each channel data in each 
DUT is also required. Thus, the conventional data 
group system cannot deal with such requirements. 

When video data is compressed corresponding 
to the MPEG system, it is very difficult to divide 
video data by a predetermined time period. Next, 
this matter will be described. 

Normally, compressed video data is generated 
in the following manner. As shown in Fig. 43, a 
picture film of 24 pictures per sec is converted into 
editing source data of 30 frames. Thereafter, the 



source data is edited and compressed. Thus, two 
groups (GOP) of video data composed of 12 pic- 
tures are generated per second. One group of 
video data is one DUT video data. As an important 
s matter, data generated from one frame of a film is 
compressed as a set because the variation thereof 
is small. 

Thus, compressed video data including 15 
frames of NTSC pictures is obtained per DUT (one 

70 GOP = 12 pictures). 

However, depending on the editing method, 
compressed video data including 15 frames per 
GOP (12 pictures) may not be generated. 

For example, as shown in Fig. 44, if 3T or later 

75 of a second editing source data of a picture film is 
cut and another editing source data generated from 
another picture film is connected thereto, after 2T 
and 2B are compressed and a second picture is 
generated, a third picture is composed of 3T and 

20 3B. Thus, 12 pictures only contain 13 frames and 
one field as NTSC pictures. 

In addition, as shown in Fig. 45, if video data is 
still picture or the like, after three frames (for exam- 
ple, 4B, 5T, and 5B) are edited, data is com- 

25 pressed and thereby 12 pictures are generated. 
Thus, in this case, the 12 pictures contain 17 
frames of NTSC pictures. 

Consequently, the number of frames contained 
in one GOP (12 pictures) varies in the range from 

30 12 frames (minimum) to 18 frames (maximum). 
Thus, since the reproducing time period varies, 
data should be re-compressed so that the repro- 
ducing time period becomes constant. This opera- 
tion should be performed for all data and thereby 

35 much labor is required. 

To reduce such labor, a system that does not 
require that the reproducing time period of one 
DUT should be fixed has been proposed. However, 
in this system, there is a problem on the synchro- 

40 nization of main picture, sound, and sub-picture 
that are being reproduced. 

In other words, to synchronize the reproduction 
of main picture, sound, and sub-picture under the 
condition of which the reproducing time period of 

45 each DUT is variable, the reproducing process of 
the sound and sub-picture should be properly con- 
trolled corresponding to the number of frames (re- 
producing time period) in the DUT to be repro- 
duced. However, the number of frames is unknown 

so until the compressed picture data is de-com- 
pressed. Thus, it is substantially difficult to . syn- 
chronize the reproduction of the main picture, 
sound, and sub-picture. 

The present invention is made from the above- 

55 described point of view. An object of the present 
invention is to provide a data unit constructing 
method, a data unit reproducing apparatus, and a 
data unit reproducing method, wherein a plurality of 



3 



3 



EP 0 677 961 A2 



4 



data blocks such as main picture, sound, sub- 
picture, and so forth are treated as one data unit 
and wherein in particular, even if sound data and 
sub-picture data are set for a plurality of channels 
or a plurality of streams, they can be precisely and 
stably divided corresponding to a block header in 
the data blocks. 

Another object of the present invention is to 
provide a data unit constructing method, a data unit 
reproducing apparatus, and a data unit reproducing 
method, wherein a plurality of data blocks such as 
main picture, sound, and sub-picture are treated as 
one data unit that is synchronously reproduced and 
wherein in particular, even if the number of display 
frames of the data unit of the main picture is 
variable, each data block can be precisely and 
stably synchronized at intervals of the frame dis- 
play of the main picture. 

To accomplish the above-described object, a 
first aspect of the present invention is a method for 
constructing a data unit having a plurality of types 
of data blocks, the data unit comprising a unit 
header disposed at the beginning of the data unit 
and adapted for controlling each of the data blocks 
as independent data of the data unit, and a block 
header disposed at the beginning of at least one of 
the data blocks and adapted for controlling data of 
the data block. 

A second aspect of the present invention is the 
method as set forth in the first aspect wherein at 
least one of the data blocks is divided into a 
plurality of groups of data, and wherein the block 
header of the data block has control information 
that represents divided positions of the groups of 
data of the data blocks. 

A third aspect of the present invention is a 
reproducing apparatus for reproducing a data unit 
having a plurality of types of data blocks, the 
apparatus comprising an input means for inputting 
the data unit, a data unit dividing means for divid- 
ing the data unit into data blocks corresponding to 
a unit header disposed at the data unit that is input 
by the input means, a data block dividing means 
for dividing the data block into groups of data 
corresponding to the block header when the block 
header is disposed at the divided data blocks, and 
a reproducing control means for reproducing only a 
predetermined one of the groups divided by the 
data block dividing means. 

A fourth aspect of the present invention is a 
method for reproducing a data unit having a plural- 
ity of types of data blocks, comprising the steps of 
inputting the data unit, dividing the data unit into 
data blocks corresponding to a unit header dis- 
posed at the data unit that is input by the input 
means, dividing the data block into groups of data 
corresponding to the block header when the block 
header is disposed at the divided data blocks, and 



reproducing only a predetermined one of the 
groups divided by the data block dividing means. 

A fifth aspect of the present invention is a 
method for constructing a data unit having a plural- 

5 rty of types of data blocks, the data unit having a 
block length equivalent to a predetermined repro- 
ducing time period that is variable in a predeter- 
mined range, the data unit comprising a unit head- 
er disposed at the beginning of the data unit and 

10 adapted for controlling each of the data blocks as 
independent data of the data unit, a main picture 
data block having picture stream data with the 
block length of the reproducing time period and a 
main picture block header that represents an effec- 

75 tive block length of the picture stream data and the 
start position of the picture stream data of main 
picture data block, a sound data block having at 
least one sound stream data with the block length 
of the reproducing time period and a sound block 

20 header that represents the effective block length of 
the sound stream data and the start position of the 
sound stream data of the sound data block, and a 
sub-picture data block having at least one sub- 
picture channel data with the block length of the 

25 reproducing time period and a sub-picture block 
header that represents the effective data length of 
the sub-picture channel data and the start position 
of the sub-picture channel data block of the sub- 
picture block data. 

30 A sixth aspect of the present invention is the 

method according to the fifth aspect, wherein the 
sound data block and the sub-picture data block 
are adjacently disposed, the effective block length 
thereof being fixed, the boundary of the sound data 

35 block and the sub-picture data block being variable 
in the range of the effective block length. 

A seventh aspect of the present invention is 
the method according to the fifth aspect, wherein 
the data blocks of the data unit that are processed 

40 chronologically independent from other data blocks 
and disposed at predetermined intervals are dis- 
posed in a plurality of data units so as to process a 
set of the data blocks as one data block, and 
wherein the unit header of the data units has in- 

45 formation that identifies the position of the data 
blocks of a predetermined data unit in the set of 
the data blocks. 

An eighth aspect of the present invention is the 
method according to the fifth aspect, wherein the 

so sound block header of the sound data block further 
includes stream position information and stream 
construction information, the stream position in- 
formation being adapted for identifying the start 
point, size, and presence/absence of the sound 

55 stream data, the stream construction information 
being adapted for identifying the construction of 
sound stream data. 
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An ninth aspect of the present invention is the 
method according to the ninth aspect, wherein the 
sound stream data is a set of a plurality of frame 
data divided by a predetermined time unit, and 
wherein the stream construction information in- 
cludes information that represents whether or not 
the pattern of each of the frame data of the sound 
stream data is the same. 

A tenth aspect of the present invention is the 
method according to the fifth aspect, wherein the 
sub-picture block header of the sub-picture data 
block further includes channel position information 
and channel display control information, the chan- 
nel position information is adapted for representing 
the start point, size, and presence/absence of each 
of the sub picture channel data, the channel dis- 
play control information being adapted for identify- 
ing the display control state of each of the sub- 
picture channel data. 

An eleventh aspect of the present invention is 
the method according to the tenth aspect, wherein 
the sub-picture channel display control information 
is adapted for identifying each of sub-picture chan- 
nel data as the following display control modes that 
are an immediate display mode for displaying the 
sub-picture channel data of a particular data unit in 
the time period of the data unit, a data hold mode 
for displaying the sub-picture channel data of a 
particular data unit in the time period of another 
data unit with a designated start time, a hold data 
display mode for issuing information of the start of 
the display of the sub-picture channel data being 
held, and a display clear mode for issuing informa- 
tion of the clear of the sub-picture channel data 
being displayed. 

A twelfth aspect of the present invention is the 
method according to the fifth aspect, wherein the 
unit header has identification information of a pre- 
determined data unit, the identification information 
comprising a program number that represents a 
program of the predetermined data unit in a set of 
data units, a data unit number that represents a 
reproduction start time of the predetermined data 
unit in the program, and information that represents 
a physical start address of the predetermined data 
unit and a physical start address of another data 
unit spaced apart therefrom by ± n. 

A thirteenth aspect of the present invention is 
the method according to the twelfth aspect, 
wherein the physical start address of the other data 
unit spaced apart from the predetermined data unit 
by ± n is represented by a relative sector number 
measured from the predetermined data unit or by a 
relative sector number measured from a boundary 
when the other data unit is not present in the 
boundary of the program. 

A fourteenth aspect of the present invention is 
the method according to the fifth aspect, wherein 



the unit header has reproducing control information 
necessary for reproducing a predetermined data 
unit, the reproducing control information including a 
program number of a program that can be repro- 

5 duced as a next program. 

A fifteenth aspect of the present invention is 
the method according to the fifth aspect, wherein 
the unit header has reproducing control information 
necessary for reproducing a predetermined data 

w unit, the reproducing control information including 
an effect setting flag for providing an effect to 
picture data and sound data of the data unit. 

A sixteenth aspect of the present invention is 
the method according to the fifth aspect, wherein 

75 the picture stream data of the main picture data 
block is composed of a group of a predetermined 
number of pictures compressed corresponding to 
MPEG system, the unit header further including the 
total number of frames of the main picture data 

20 block being reproduced and information that repre- 
sents a display start frame number of a reference 
screen of the picture data. 

A seventeenth aspect of the present invention 
is the method according to the fifth aspect, wherein 

25 the sub-picture data blocks are disposed in N data 
units (where N is any integer that is equal to or 
larger than 2), the unit header further including 
information that represents the total number of 
frames of the N data units of the main picture data 

30 blocks being reproduced and a display start frame 
number of a reference screen in the last one of the 
N data units. 

An eighteenth aspect of the present invention 
is a reproducing apparatus for reproducing a data 

35 unit having a plurality of types of data blocks, 
comprising a frame number counting means for 
counting a reproduced frame number of a main 
picture corresponding to a reproduced output sig- 
nal of the main picture, a reproducing process 

40 means for inputting the reproduced frame number 
that is output from the frame number counting 
means and reproducing sound data or sub-picture y 
data in synchronization with the reproduction of the 
main picture corresponding to the reproduced 

45 frame number, a first comparing means for com- 
paring the reproduced frame number obtained by 
the frame number counting means with the total 
number of frames of the main picture data block 
read from a unit header and resetting the frame 

so number counting means when the reproduced 
frame number and the total number of frames ' 
match, a reference screen detecting means for 
detecting the start of the reproduction of the refer- 
ence screen corresponding to the reproduced data 

55 of the main picture, a second comparing means for 
comparing the reproduced frame number obtained 
by the frame number counting means with a dis- 
play start frame number of the reference screen 
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that is read from the unit header when the start of 
the reproduction of the reference screen is de- 
tected by the reference screen detecting means, a 
down-counting means for counting down the dif- 
ference between the reproduced frame number and 
the display start frame number of the reference 
screen at intervals of the frame display when the 
reproduced frame number is larger than the display 
start frame number of the reference screen, a stor- 
ing means for storing reproduced data of a sub- 
picture of one frame prior, a switching means for 
switching reproduced data between sub-picture of 
one frame prior stored in the storing means and 
sub-picture of the present frame, and a means for 
controlling the switching means to select the repro- 
duced data of the sub-picture stored in the storing 
means and stop the counting operation of the 
frame number counting means when the difference 
held by the down-counting means is other than 0. 

A nineteenth aspect of the present invention is 
the reproducing apparatus according to the eigh- 
teenth aspect, wherein the reproducing process 
means comprises a decoding means for decoding 
sound data or sub-picture data and obtaining a 
sound output or a sub-picture output, and a buffer 
means for storing pre-decoded sub-picture data of 
the present frame, wherein the storing means is 
adapted for storing predecoded sub-picture data of 
one frame prior, and wherein the switching means 
is adapted for selecting sub-picture data stored in 
the storing means and outputting the selected sub- 
picture data to the decoding means when the dif- 
ference counted by the down-counting means is 
other than 0 and for selecting sub-picture data of 
the present frame and outputting the selected data 
to the decoding means when the difference count- 
ed by the down-counting means is 0. 

A twentieth aspect of the present invention is 
the reproducing apparatus according to the eigh- 
teenth aspect, wherein the reproducing process 
means has decoding means for decoding sound 
data or sub-picture data and outputting decoded 
sound or decoded sub-picture, wherein the storing 
means is adapted for storing reproduced sub-pic- 
ture data of one frame prior obtained by the decod- 
ing means, and wherein the switching means is 
adapted for selecting sub-picture data stored in the 
storing means and outputting the selected sub- 
picture data when the difference counted by the 
down-counting means is other than 0 and for se- 
lecting sub-picture data of the present frame that is 
output from the decoding means and outputting the 
selected data when the difference counted by the 
down-counting means is 0. 

A twenty-first aspect of the present invention is 
the reproducing apparatus according to the eigh- 
teenth aspect, the apparatus further comprising a 
reproduction controlling process means for deter- 



mining whether or not a sub-picture reproduction 
controlling process is present between a reproduc- 
ing start frame of the reference screen and a 
reproduced frame obtained by the frame number 

5 counting means when the display start frame num- 
ber of the reference screen is larger than the 
reproduced frame obtained by the frame number 
counting means corresponding to the compared 
result of the second comparing means, a reproduc- 

10 ing process forcing means for forcedly performing 
the reproducing control process when it is deter- 
mined that there is the reproduced control process, 
and a setting the reproduced start frame number of 
the reference screen to the frame number counting 

75 means after the reproducing control process is 
completed. 

According to the present invention, since a 
block header is provided at the beginning of a data 
block so as to control data in the data block, the 

20 data in the data block can be easily controlled in 
smaller units such as channels and streams cor- 
responding to the block header. 

According to the present invention, since a 
block header including control information that re- 

25 presents divided positions of data of groups in a 
data block is provided at the beginning of the data 
block, data of each group in the data block can be 
divided corresponding to the control information. 
According to the present invention, since a 

30 block header that represents valid block length and 
start position of data of independent units (stream 
units and channel units) is provided in a main 
picture data block, a sound data block, and a sub- 
picture data block, data of each block can be easily 

35 and precisely controlled corresponding to the block 
header. 

According to the present invention, since the 
boundary of a sound data block and a sub-picture 
data block is variable in the range of the maximum 

40 block length of a combination of a sound data 
block and a sub-picture data block that are adja- 
cently disposed, if necessary, the sound data block 
can be extended for improving the sound data. 
Alternatively, the block length of the sub-picture 

45 data can be extended so as to increase information 
amount of superimposed text. 

According to the present invention, since a unit 
header in a data unit has information that identifies 
a data block number included therein, when a 

so plurality of data blocks in the data unit are pro- 
cessed chronologically independent from other 
data blocks and disposed at predetermined inter- 
vals, the data blocks can be processed in a plural- 
ity of data units so that they can be processed as 

55 one data block. 

According to the present invention, start point, 
size, and presence/absence of each sound stream 
data in a data unit can be identified corresponding 
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to stream position information of a sound block 
header. In addition, the construction of each sound 
stream data can be identified corresponding to the 
stream construction information. 

According to the present invention, since in- 5 
formation that represents that the pattern of each 
frame data is the same is provided as stream 
construction information, it is not necessary to con- 
tinuously record and reproduce the same frame 
data. 10 

According to the present invention, the start 
point, size, and presence/absence of each sub- 
picture channel data in a data unit can be identified 
corresponding to channel position information of a 
sub-picture block. In addition, the content of the 15 
display control of the sub-picture channel data can 
be identified as categories such as immediate dis- 
play mode, data hold mode, hold data display 
mode, display clear mode, and so forth as in claim 
10 corresponding to the channel display control 20 
information. 

According to the present invention, for a pro- 
gram that is composed of a set of data units, a 
program that includes a particular data unit, re- 
producing start time of the particular data unit in 25 
the program, a physical start address of the par- 
ticular data unit, and a physical start address of 
another data unit spaced apart from the particular 
data unit by ± n can be identified. 

According to the present invention, a physical 30 
start address of a data unit spaced apart from a 
particular data unit by ± n is represented by a 
relative sector number measured from the particu- 
lar data unit. When a data unit spaced apart from a 
particular data unit by ± n is not present in the as 
boundary of data, the physical start address is 
represented by a relative sector to the boundary. 
Thus, even if a data unit spaced apart form a 
particular data unit for ± n is not present in the 
boundary, a branch process and a termination pro- 40 
cess can be preformed. 

According to the present invention, a program 
number of a program that can be successively 
reproduced after a program including a data unit 
can be identified. 45 

According to the present invention, an external 
effect process can be performed for each data unit 
corresponding to an effect setting flag. 

According to the present invention, when the 
number of frames reproduced from main picture 50 
data for each data unit (namely, reproducing time 
period is variable for each data unit), the reproduc- 
tion of main picture, sound, and sub-picture can be 
synchronized. 

According to the present invention, when a 55 
sub-picture data block is disposed in N data units 
(where N is an integer that is equal to or larger 
than 2), the reproduction of main picture, sound, 



and sub-picture can be synchronized. 

These and other objects, features and advan- 
tages of the present invention will become more 
apparent in light of the following detailed descrip- 
tion of a best mode embodiment thereof, as illus- 
trated in the accompanying drawings. 

Fig. 1 is a block diagram showing the construc- 
tion of a moving picture type optical disc re- 
producing apparatus according to an embodi- 
ment of the present invention; 
Fig. 2 is a schematic diagram showing a data 
format of an optical disc reproduced by the 
optical disc reproducing apparatus of Fig. 1; 
Fig. 3 is a schematic diagram showing the con- 
struction of a DUT; 

Fig. 4 is a table showing the construction of a 
DUT header; 

Fig. 5 is a table showing DUT construction iden- 
tification information; 

Fig. 6 is a block diagram showing the construc- 
tion of a system processor (SYS-PRO) portion; 
Fig. 7 is a schematic diagram showing a data 
dividing process block in an ARBX portion; 
Fig. 8 is a timing chart showing the generation 
of a select signal for dividing DUT data into 
blocks; 

Fig. 9 is a schematic diagram for explaining an 

variation of boundary of a sub-picture data block 

and an audio data block in the DUT; 

Fig. 10 is a schematic diagram showing a non- 

interieave mode of sub-picture data; 

Fig. 11 is a schematic diagram showing an 

interleave mode of sub-picture data; 

Fig. 12 is a timing chart showing reproduction of 

sub-picture data in the non-interieave mode and 

the interleave mode; 

Fig. 13 is a schematic diagram showing the 
construction of an audio data block; 
Fig. 14 is a table showing the construction of an 
audio block header; 

Fig. 15 is a schematic diagram showing invalid 

data in the audio data block; 

Fig. 16 is a schematic diagram showing the 

construction of an audio stream; 

Fig. 17 is a schematic diagram for explaining a 

reproducing process in a reduction mode of 

audio data; 

Fig. 18 is a schematic diagram showing a sub- 
picture data block; 

Fig. 19 is a table showing the construction of a 
sub-picture block header; 
Fig. 20 is a table showing the construction of a 
sub-picture data header according to an em- 
bodiment of the present invention; 
Fig. 21 is a schematic diagram for explaining a 
display control method of sub-picture data; 
Fig. 22 is a table showing the construction of 
DUT identification and search information in a 
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DUT header; 

Fig. 23 is a schematic diagram for explaining 
sector number information for high speed 
searching in the DUT header; 
Fig. 24 is a flow chart showing steps of high 
speed searching corresponding to sector num- 
ber information of Fig. 23; 
Fig. 25 is a schematic diagram for explaining 
the operation in the case that no desired jump 
destination is present in high speed searching; 
Fig. 26 is a table showing DUT reproduction 
control information in the DUT header; 
Fig. 27 is a block diagram showing the construc- 
tion of a non-continuous program detecting pro- 
cess block in an ARBX portion; 
Fig. 28 is a schematic diagram for explaining a 
broken link process; 

Fig. 29 is a block diagram showing the construc- 
tion of an effect detecting block in the ARBX 
portion; 

Fig. 30 is a schematic diagram for explaining 
the effect process; 

Fig. 31 is a schematic diagram for explaining 
the construction of a video data block; 
Fig. 32 is a table showing the construction of a 
video block header; 

Fig. 33 is a table showing the construction of a 
video block; 

Fig. 34 is a schematic diagram for explaining 
the total number of frames and an I picture 
display start frame number in the interleave 
mode; 

Fig. 35 is a block diagram showing the construc- 
tion of a frame number generating process 
block; 

Fig. 36 is a block diagram showing the construc- 
tion of a sub-picture reproducing portion in the 
process block of Fig. 35; 

Fig. 37 is a flow chart showing a process se- 
quence of the process block of Fig. 35; 
Fig. 38 is a block diagram showing the construc- 
tion of a sub-picture process portion of a frame 
number generating process block according to 
another embodiment of the present invention; 
Fig. 39 is a flow chart showing a process se- 
quence of the process block of Fig. 38; 
Fig. 40 is a block diagram showing the construc- 
tion of a process block in a picture reproducing 
portion in the case that K < J in a comparator of 
the process block of Fig. 35; 
Fig. 41 is a flow chart showing a process se- 
quence of the process block of Fig. 40; 
Fig. 42 is a schematic diagram showing the data 
construction of a file of a conventional optical 
disc; 

Fig. 43 is a schematic diagram for explaining an 
editing method of compressed video data; 



Fig. 44 is a schematic diagram for explaining a 
data connecting method in editing compressed 
vide data; and 

Fig. 45 is a schematic diagram for explaining a 

s method for compressing data of three frames so 
as to generate 12 pictures of data. 
Next, with reference to the accompanying 
drawings, embodiments of the present invention 
will be described in detail. 

w Fig. 1 is a block diagram showing the construc- 
tion of a moving picture type optical disc reproduc- 
ing apparatus according to the present invention. 

As shown in Fig. 1 , the optical disc reproduc- 
ing apparatus comprises a key input portion 2, a 

75 system ROM and RAM portion 3, a video decoder 
4, a D/A and reproducing process portion 5, an 
optical disc drive portion 6, a CPU portion 7, a 
system processor portion (hereinafter referred to as 
SYS-PRO portion) 8, a data RAM portion 9, an SP 

20 (sub-picture) decoder portion 10, an audio decoder 
portion 11, and a TV portion 12. The key input 
portion 2 allows the user to input various com- 
mands such as reproduction, stop, fast forward, 
fast rewind, superimpose display, and so forth for 

25 the optical disc reproducing apparatus. The ROM 
of the system ROM and RAM portion 3 stores a 
control program (software) for controlling the oper- 
ations of the apparatus. When the power of the 
apparatus is turned on, the control program is read 

30 to the CPU portion 7. The RAM of the system 
ROM and RAM portion 3 has a working region in 
which data is processed. 

In the optical disc reproducing apparatus 1 , the 
CPU portion 7 sends a desired address and a read 

35 command to the optical disc drive portion 6 cor- 
responding to the key operation of the key input 
portion 2. The optical disc drive portion 6 reads 
data from the optical disc corresponding to the 
received command and sends the data to the SYS- 

40 PRO portion 8. The SYS-PRO portion 8 temporarily 
stores the data (digital data) in the data RAM 
portion 9 and divides the data into MPEG com- 
pressed moving picture data (hereinafter referred to 
as video data), sound data, sub-picture data, and 

45 so forth. In addition, the SYS-PRO portion 8 sends 
the video data to the video decoder portion 4, the 
sound data to the audio decoder portion 11, and 
the sub-picture data (for reproducing superimposed 
text and simple animation data) to the SP decoder 

50 portion 10. Each of the decoder portions 4, 10, and 
11 decodes the input data and outputs the de- 
coded data to the D/A and reproducing process 
portion 5. The D/A and reproducing process portion 
5 converts the decoded digital signal into an analog 

55 signal and outputs the analog signal to the TV 
portion 12. 

Fig. 2 is a schematic diagram showing the data 
format of the optical disc. Referring to Fig. 2, files 
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stored on the optical disc are hierarchically con- 
structed. Each file accords with one story. One 
story is constructed of a plurality of programs. One 
program is constructed of a plurality of data units 
(hereinafter referred to as DUT). Since one pro- 
gram is constructed of a plurality of DUTs, the 
reproducing order of each program can be 
changed and each process can be branched. In 
addition, an effect process can be performed for 
each DUT. One DUT is composed of a DUT header 
HD, a sub-picture block data SP, an audio block 
data A, and a video block data V. The sub-picture 
block data, the audio block data, and the video 
block data are reproduced on the same time axis. 

Fig. 3 is a schematic diagram showing the 
construction of the DUT of Fig. 2. 

As shown in Fig. 3, the reproducing time pe- 
riod of one DUT can be varied in . the range from 
0.4 sec. to 0.8 sec. As shown in Fig. 2, the length 
of the DUT header HD is fixed. On the other hand, 
the length of each of the sub-picture data block SP, 
the audio data block A, and the video data block V 
is variable depending on the DUT reproducing time 
period, presence/absence of data compression, 
and the compressing system. 

The DUT header contains various control in- 
formation for each data block in the DUT. The sub- 
picture data block is composed of a plurality of 
sub-picture channels 1, 2 and i and a sub- 
picture block header that contains control informa- 
tion for each channel data. The audio data block is 
composed of a plurality of audio streams 1, 2, .... 
and j and an audio block header that contains 
control information for audio data of each stream. 
The video data block is composed of a video 
stream that is for example MPEG compressed 
moving picture data and a video block header that 
contains control information for the video stream. 

Fig. 4 is a table showing the construction of the 
DUT header. 

Referring to Fig. 4, the DUT header is com- 
posed of DUT identification and search information, 
DUT reproducing control information, DUT con- 
struction identification information, sub-picture 
block construction information, audio block con- 
struction information, video block construction in- 
formation, reserved information, and so forth. When 
a file is generated, it is assumed that a read error 
of the DUT header takes place. To prevent the 
read error, each information is recorded on the disc 
four times. 

Each of the sub-picture block construction in- 
formation, audio block construction information, and 
video block construction information contains sec- 
tor alignment information that represents sector 
numbers with which each data block starts and 
ends. 



As shown in Fig. 5, the DUT construction iden- 
tification information contains the divided point start 
address of each sub-picture data block 
(SPBSADR), its size (SPBSIZE), the divided point 

5 start address of each audio data block (ABSADR), 
its size (ABSIZE), the divided point start address of 
each video data block (VBSADR), its size 
(VBSIZE), and so forth. The divided point start 
address of each data block is represented by a 

to relative address measured from the beginning of 
the DUT. The size of each address is represented 
by bytes. 

Next, the construction of the SYS-PRO portion 
8 of the optical disc reproducing apparatus of Fig. 
75 1 will be described. Fig- 6 is a block diagram 
showing the construction of the SYS-PRO portion 
8. 

As shown in Fig. 6, the SYS-PRO portion 8 
comprises a drive l/F portion 21, an ABRX portion 
20 22, a HST l/F portion 23, a CACHPNT portion 24, 
an audio l/F portion 25, a DRAM control portion 
(DRAMC portion) 26, data select portions 27 and 
29, a D-type flip-flop (DF) 28, and a video l/F 
portion 30. 

25 The SYS-PRO portion 8 determines a sector 
alignment position corresponding to each block 
construction information of a DUT being read and 
performs a dividing process for each data block in 
the DUT. The video data block is sent to the video 

30 decoder portion 4. The sub-picture data block is 
sent to the SP decoder portion 10. The audio data 
block is sent to the audio decoder portion 1 1 . 

The ARBX portion 22 of the SYS-PRO portion 
8 generates a data dividing signal for the dividing 

35 process. The data dividing signal is a select signal 
for dividing data blocks of the DUT corresponding 
to their types. 

Fig. 7 is a block diagram showing the construc- 
tion of a data dividing process block of the ARBX 

40 portion 22. Referring to Fig. 7, the data dividing 
process block comprises a drive l/F portion 37, an 
SPBSADR REG (SPBSADR register) 38, an 
SPBSIZE REG (SPBSIZE register) 39, an SP end 
address calculating address adder 40, a DUT data 

45 counter 41, an SP data start generating address 
comparator 42, a constant setting register 43 
(transfer counter 73), an SPBSADR register load 
signal generating address comparator 44, a con- 
stant setting register 45 (transfer counter 74), an 

50 SPBSIZE register load signal generating address 
comparator 46, a constant setting register 47 
(transfer counter 75), an SP data end generating 
address comparator 48, an ABSADR REG (AB- 
SADR register) 49, an SP data select signal gen- 

55 erating RS flip-flop (RS-F/F) 50, an ABSADR regis- 
ter load signal generating address comparator 51, a 
constant setting register 52 (transfer counter 76), 
an ABSIZE register load signal generating address 



9 



15 



EP 0 677 961 A2 



16 



comparator 53 f an audio data start generating ad- 
dress comparator 54, an ABSIZE REG (ABSIZE 
register) 55, an audio end address calculating ad- 
dress adder 56, an audio data start generating 
address comparator 57, a VBSADR REG (VBSADR 
register) 58, an audio data select signal generating 
RS flip-flop 59, a VBSADR register load signal 
generating address comparator 60, a constant set- 
ting register 61 (transfer counter 78), a VBSIZE 
register load signal generating address comparator 
62, a video data start generating address compara- 
tor 63, a VBSIZE REG (VBSIZE register) 64, a 
video end address calculating address adder 65, a 
video data end generating address comparator 66, 
a video data select signal generating RS flip-flop 
67, and a constant setting register 68 (transfer 
counter 77). It should be noted that when the DUT 
data counter 41 counts each transfer data 73 times, 
data is read to the constant setting register 43 
(transfer counter 73). This operation applies to the 
other registers. 

The SYS-PRO portion 8 reads the DUT header 
and records it to the data RAM 9 and stores the 
DUT construction identification information of the 
DUT header to each register of the ABRX portion 
22. In addition, the SYS-PRO portion 8 performs 
the following processes corresponding to the DUT 
construction identification information. 

As shown in Fig. 8, the drive l/F 37 sends the 
parameters (SPBSADR, SPBSIZE, ABSADR, AB- 
SIZE, VBSADR, and VBSIZE) of the DUT construc- 
tion identification information to each register while 
the transfer counter are counting from 72 to 78. 
The address comparators, the adders, and the flip- 
flops of the ABRX portion 22 generate each data 
dividing signal (data select signal). 

When a signal for selecting sub-picture data 
(this signal is referred to as SP data select signal) 
is generated, the parameter SPBSADR is stored in 
the SPBSADR REG (register) 38 of the ABRX 
portion 22. The comparator 42 compares the value 
stored in the register 38 with the DUT data. When 
they match, a set signal "S" is sent to the flip-flop 
50 (RS-F/F) 50. The parameter SPBSIZE is stored 
in the SPBSIZE REG (register) 39 of the ABRX 
portion 22. The adder 40 adds the value stored in 
the register 39 and the value stored in the 
SPBSADR REG 38. The comparator 48 compares 
the added result with the DUT data. When they 
match, a reset signal "R" is sent to the RS-F/F 50. 
The RS flip-flop 50 operates corresponding to the 
"S" and "R" signals and thereby generates the 
sub-picture a sub-picture data select signal. Like- 
wise, an audio data select signal, a video data 
select signal, and so forth are generated. 

The reproducing time period of a DUT can be 
varied in the range from 0.4 sec. to 0.8 sec. Thus, 
the entire block length can be varied. However, in 



the optical disc reproducing apparatus, due to the 
restriction of hardware (for example, the amount of 
data reproduced from an optical disc per unit time 
period is restricted), the entire block length of each 

5 DUT is defined as its maximum amount. 

From such a point of view, according to this 
embodiment, as shown in Fig. 9, the boundary 
(divided point) of the sub-picture data block and 
the audio data block can be varied in the range of 

10 the maximum block length thereof. 

Thus, in a particular DUT, the block length of 
audio data can be extended so as to improve 
sound quality. In contrast, the block length of the 
sub-picture data can be extended so as to increase 

75 information amount of for example superimposed 
text. In addition, the region of the maximum block 
length of a combination of audio data and sub- 
picture data can be occupied by only the audio 
data block or the sub-picture data block. 

20 The sub-picture data in the sub-picture data 
block is divided into channels that can be indepen- 
dently reproduced. A selected one of the channels 
is reproduced as sub-picture channel data. 

The sub-picture data has two modes (that are 

25 non-interieave mode and interleave mode). As 
shown in Fig. 10, the non-interleave mode has up 
to 1 6 channels of sub-picture data in one DUT. On 
the other hand, as shown in Fig. 11, the interleave 
mode has up to 32 channels of sub-picture data in 

30 two successive DUTs that are equivalent to the 
reproducing time period of one second. 

To identify the modes of the sub-picture data, 
according to this embodiment, as shown in Figs. 19 
and 26, information that represents whether sub- 

35 picture data is in the interleave mode or non- 
interleave mode is recorded at the seventh and 
sixth bits of the SPSNO parameter of the DUT 
header. In addition, information that represents a 
DUT number of sub-picture data in the interleave 

40 mode is recorded at 0-th bit of the parameter. 

In the interleave mode, since sub-picture data 
reproduced at the same reproducing time period is 
present in two DUTs, as shown in Fig. 12, the 
reproducing operation is performed after data of 

45 two DUTs (namely, data of 32 channels) have been 
prepared. Thus, the reproduction in the interleave 
mode has a delay for one DUT time period (name- 
ly, approximately 0.5 sec.) against that in the non- 
interleave mode. 

so The audio data in the audio data block is 
divided into streams that can be independently 
reproduced. Thus, a selected one of the streams is 
reproduced. Fig. 13 is a schematic diagram show- 
ing the construction of the audio data block. As 

55 shown in Fig. 13, an audio data block is composed 
of a plurality of audio streams and an audio block 
header. The audio block header is followed by the 
audio steams. As shown in Fig. 14, the audio block 
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header has an audio block identifier (ABID) that 
represents an audio data block. The audio block 
identifier (ABID) is recorded at the first byte of the 
audio block header. As shown in Rg. 15, the audio 
data block may have invalid data (as denoted by 
hatched region in Rg. 15). TTius, the audio block 
header contains an audio block size (ABSIZE), a 
synchronous pointer (AVSYNC), and stream data 
start address (AADRS*). The audio block size (AB- 
SIZE) represents the effective block length of the 
audio data block. The synchronous pointer (AV- 
SYNC) synchronizes audio data with the main pic- 
ture. The stream data start address (AADRS*) is a 
relative address measured from the beginning of 
the audio data block. "*" in AADRS* represents a 
stream number that ranges from 0 to 8. When 
relative address = $0000. AADRS" represents "no 
stream data". 

As shown in Rg. 16, each audio stream in the 
audio data block is divided into smaller units that 
are referred to as sound frames. When each of 
sound frames that compose one audio stream has 
the same data pattern, "1" is set to 31st bit C of 
the parameter AADRS* shown in Rg. 14. 

When the optical disc reproducing apparatus 
has determined the 31st bit C of the parameter 
AADRS* is "1 ", the apparatus performs a reproduc- 
ing process in a reduction mode. In the reduction 
mode, as shown in Rg. 17, one frame of a re- 
peated data pattern is sent to the sound decoder 
and the decoded result is repeatedly output for the 
frames recorded at the 24th to 30th bits of the 
parameter AADRS*. Thus, it is not necessary to 
repeatedly send the same data. 

Rg. 18 is a schematic diagram showing the 
construction of the sub-picture data block. As 
shown in Rg. 18, the sub-picture data block is 
composed of a plurality of sub-picture channels 
and a sub-picture block header. The sub-picture 
block header is followed by the sub-picture chan- 
nels. As shown in Rg. 19, a sub-picture block 
identifier (SPBID) that represents a sub-picture 
block is recorded at the first byte of the sub-picture 
block header. The sub-picture block header con- 
tains a sub-picture block size (SPBSIZE) and sub- 
picture channel data start address (SPADRC**). The 
sub-picture block size (SPBSIZE) represents the 
effective block length of the sub-picture data block. 
The sub-picture channel data start address 
(SPADRC**) is a relative address measured from 
the beginning of the sub-picture data block. "**" of 
the parameter SPADRC** is a channel number that 
ranges from 0 to 16. 

Each sub-picture channel is composed of a 
channel header and a plurality of sub-picture dis- 
play data frames. As shown in Rg. 20, the channel 
header contains a sub-picture display data start 
address (SPDDADR), a sub-picture control data 



start address (SPCDADR), a sub-picture display 
start position (SPDSIZE), a sub-picture color in- 
formation (SPCINFO), sub-picture edge compen- 
sating information (SPADJINFO), a mixed ratio of a 

5 sub-picture and a main picture (SPCOUNT), a sub- 
picture display start timing (SPDST), and so forth. 

As shown in Rg. 19, a code that identifies a 
display control mode of the sub-picture channel 
data is set at the 31st to 28th bits of the start 

w address (SPADRC**)- The 31st to 28th bits are 
denoted by "D", "W", "S", and "C", respectively. 
When D = 1, channel data is present. In this 
mode, a sub-picture is displayed as it is. This 
mode is referred to as an immediate display mode. 

75 When W = 1, although channel data is present, it 
is not displayed until S = 1. This mode is referred 
to as a data hold mode. When S = 1 , data that is 
read in the condition of W = 1 is displayed. This 
mode is referred to as a hold data display mode. 

20 When C = 1, the sub-picture screen is cleared. 
This mode is referred to as a display clear mode. 
In this mode, a sub-picture screen is cleared rather 
than a moving picture screen. 

Next, with reference to Fig. 21, sub-picture 

25 data display control method corresponding to D, 
W, S, and C will be described. 

In Rg. 21, in DUT 10, D = 1, W = 0, S = 0, 
and C = 0. Since the mode of DUT 10 is in that 
"no first read" and "no screen clear", sub-picture 

30 data that is read from DUT 10 is reproduced as it 
is. In DUT 11, D = 0, W = 1, S = 0, and C = 0. 
The mode of DUT 11 is in that "first read of sub- 
picture data" and "no screen clear". Thus, the sub- 
picture data read from DUT 1 1 is not reproduced at 

35 this point, but reproduced when S = 1. Con- 
sequently, at this point, the sub-picture data of 
DUT 10 is displayed on the screen. In DUT 12 and 
DUT 13, D = 0, W = 0, S = 0, and C = 0. The 
mode of DUT 12 and DUT 13 is in that "no sub- 

40 picture data" and "no screen clear". Thus, sub- 
picture data is not read and the screen is held as it 
is. In DUT 14, D = 0, W = 0, S = 1, and C = 0. 
Thus, the mode of DUT 14 is in that "buffer data 
reproduction start" and "no screen clear". Con- 

45 sequently, according to a display frame number 
recorded in the sub-picture display start timing 
parameter (SPDST) of the channel header shown in 
Rg. 20, the sub-picture data read from DUT 11 is 
reproduced. In DUT 16. D = 0. W = 0, S = 0, 

so and C = 1. Thus, the mode of DUT 16 is in that 
"no sub-picture data" and "screen clear". Con- 
sequently, the sub-picture display screen is 
cleared. 

Rg. 22 is a table showing the construction of 
55 the DUT identification and search information in the 
DUT header. As shown in Rg. 22, the DUT iden- 
tification and search information contains a DUT 
program number (PRGNO), a DUT serial number 
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(DUTNO), a DUT file start address (FSADRS), and 
so forth. 

In addition, so as to easily perform a high 
speed searching operation, as shown in Fig. 23, the 
DUT identification and search information contains 
sectors numbers counted from the beginning of the 
DUT header. The sector numbers are 10 reproduc- 
ing units forward (FWD10), five reproducing units 
forward (FWD5), one reproducing unit forward 
(FWD1), one reproducing unit backward (BWD1), 
five reproducing units backward (BWD5), and 10 
reproducing units backward (BWD10). However, it 
should be noted that the reproducing units are 
continuous DUTs to be reproduced. 

Thus, in the case that the high speed (forward) 
searching operation is performed, as shown in a 
flow chart of Fig. 24, when a forward key (») of 
the key input portion 2 is operated (pressed), the 
optical disc drive portion 6 drives the optical disc, 
reads DUT data from a desired file, and sends the 
read data to the SYS-PRO portion 8. When the 
SYS-PRO portion 8 receives the DUT data (at step 
S1), the CPU portion reads the sector number data 
in the high speed searching operation from the 
data RAM portion 9, calculates the next address (at 
step S2), and sends the address and the search 
command to the optical disc drive portion 6 (at 
step S3). Thus, the optical disc drive portion 6 
reads the next DUT data and sends it to the SYS- 
PRO portion 8 (at step S4). Thus, the fast re- 
producing operation can be performed. This opera- 
tion is continued while the fast forward key (») of 
the key input portion 2 is being pressed. When the 
fast forward key (») is released, the CPU portion 
7 determines that the high speed searching opera- 
tion is stopped (at step S5). The fast rewind opera- 
tion is performed in the same manner as the high 
speed searching operation. 

When the reproduction of DUTs is branched in 
the middle thereof or the reproduction of a file is 
completed, since there are no reproducing 
units forward and backward, the available sector 
number data is recorded. represents an integer 
such as 1, 5, or 10. 

For example, as shown in Fig. 25, when a file 
is completed before branched to a DUT that is five 
reproducing units froward (FWD5) or 10 reproduc- 
ing units forward (FWD10), assuming that DUT 19 
is the start point, the sector number with which the 
file ends (such as DUT 22) is recorded as a DUT 
that is five reproducing units forward (FWD5) or 10 
reproducing units forward (FWD10). The sector 
number represents the number of sectors counted 
from the beginning of the DUT header to a desired 
DUT. 

Fig. 26 is a table showing DUT reproducing 
control information in the DUT header. As shown in 
Fig. 26, the DUT reproducing control information 



has parameters that are a related program number 
(RPROGNO), a picture synchronous pointer (AV- 
SYNC), a sub-picture dividing number (SPSNO), a 
parental (PARENT), an edge effect (EFECT), and 

s so forth. 

The related program number (RPRGNO) is a 
default program number that can be successively 
reproduced. When a program is not designated, 
the related program number (RPGNO) represents a 

10 next program to be reproduced. 

When another program is successively repro- 
duced, since the data is not continued, noise takes 
place in the sound and picture. To prevent this 
problem, as shown in Fig. 27, a non-continuous 

75 program detecting process block 78 is disposed in 
the ARBX portion 22. 

Referring to Fig. 27, the non-continuous pro- 
gram detecting process block 78 comprises a drive 
l/F portion 69, a PRGNO register 70, a DUT data 

20 counter 71, a RPRGNO register 72, a constant 
setting register 73 (transfer counter 1), a PRGNO 
register load signal generating address comparator 
74, a constat setting register 75 (transfer counter 
65), a RPRGNO register load signal generating 

25 address comparator 76, and a broken link process 
flag signal generating comparator 77. 

When a program other than a program des- 
ignated corresponding to the DUT reproducing 
control information is reproduced, it is determined 

30 that the comparing process of one DUT prior is 
completed. The detected signal that is a latch 
signal is output to a D-type flip-flop (D-F/F) 86. 
Thus, the D-type flip-flop (D-F/F) 86 outputs a 
related program number of a DUT of one reproduc- 
es ing unit backward. On the other hand, a program 
number of a DUT that is being reproduced is read 
to the register 70. The D-type flip-flop (D-F/F) 86 
compares the related program number of the DUT 
that is one reproducing unit backward with the 

40 program number of the program being reproduced. 
Thus, a broken link process enable flag signal is 
generated. After the above-determination, sound is 
muted for several frames and a process for 
smoothly switching moving picture data (namely, 

45 broken link process) is performed. 

Next, a process sequence for which the broken 
link enable flag signal is generated will be de- 
scribed. 

For example, as shown in Fig. 28, when pro- 
50 grams are successively reproduced in the order of 
program "1" -> program "2" -> program "4" -> 
program "6", the program number (RPRGNO) in 
the program "1" becomes "2" and the program 
number (RPRGNO) in the program "2" becomes 
55 "4". 

In the case that the program "2" is branched to 
the program "3" by the user operation, when the 
data of the program "3" is read, the just preceding 

12 
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program is "4". Thus, the program "3" cannot be 
reproduced. In this situation, the broken link pro- 
cess flag signal becomes active. 

The edge effect parameter (EFFECT) shown in 
Fig. 26 is information that represents the occur- 
rence of the edge effect in picture data and sound 
data for each DUT. 

Fig. 29 is a block diagram showing the con- 
struction of an effect detecting block 84 in the 
ARBX portion 22. Referring to Fig. 29, the effect 
detecting block 84 comprises a drive l/F portion 79, 
an effect register 80, a DUT data counter 81, a 
constant setting register 82 (transfer counter 71), 
and an effect register load signal generating ad- 
dress comparator 83. The effect detecting block 84 
receives the edge effect parameter (EFFECT) from 
the DUT reproducing control information and there- 
by generates an effect process signal. 

In this case, as shown in Fig. 30, when the 
EFFECT bit of for example DUT 21 is set, the 
effect flag becomes active and thereby the effect 
process signal is generated. When this signal is 
sent to the CPU portion 7, the video decoder 
portion 4, the audio decoder portion 11, the SP 
decoder portion 10, the D/A and reproducing pro- 
cess portion 5, an external device (such as lighting 
device or an air conditioner), and so forth, various 
edge effects can be obtained. In this embodiment, 
as shown in Fig. 30, the display screen can be 
faded out when a main picture is ended. 

In addition, the effect process includes a fad-in 
process, lighting varying process that varies the 
brightness of an external lighting (for example, the 
external lighting is turned off in a climax scene of a 
horror story), control of external illumination, control 
of external air-conditioning facility (for example, the 
room temperature is lowered in a cold scene of a 
snow-covered mountain and raised in a hot scene 
of a desert), and sound effects of such as clapping 
of hands and putting in interlude. 

Fig. 31 is a block diagram showing the con- 
struction of a video data block. As described 
above, the video data block is composed of a 
plurality of video streams and a video block head- 
er. The video data header is followed by the video 
streams. As shown in Fig. 32, the video block 
header includes a video block identifier (VBID), a 
video block size (VBSIZE), and so forth. The video 
block identifier (VBID) represents that the block is a 
video block. The video block size (VBSIZE) repre- 
sents the effective block length of a video stream 
in the video data block. 

As shown in Fig. 33, the video block construc- 
tion information in the DUT header contains the 
start address of each video picture represented by 
a relative address (VADRF*) measured from the 
beginning of the video data block. When the rela- 
tive address = $0000, the video block construction 



information represents "no picture data". When the 
31st bit C of the relative address VADRF is set to 
"1", the screen is cleared. In this case, only the 
main picture is cleared, rather than the sub-picture. 
5 Since the DUT header has information that 

represents the start address of each video picture, 
high speed special reproducing operation such as 
double speed reproducing operation can be ac- 
complished. 

70 The sub-picture reproducing portion that per- 
forms the reproducing process for sub-picture data 
counts the VSYNC signal (vertical synchronous sig- 
nal) that is input from the main picture decoder 
portion so as to synchronize the reproduction of 

75 the sub-picture with the reproduction of the main 
picture corresponding to the frame number of the 
main picture. 

However, as descried in the related art section 
of this document, the number of frames that are 

20 obtained as a result of decoding of one GOP (12 
pictures) varies in the range from 12 to 18. Thus, 
the number of frames varies depending on each 
DUP. Consequently, when only the frame number 
of the main picture that is obtained by counting the 

25 VSYNC signal (vertical synchronous signal) is 
used, the last frame of each DUT cannot be deter- 
mined. Thus, precise synchronization of main pic- 
ture and sub-picture cannot be obtained. 

Thus, in this embodiment, as shown in Fig. 26, 

30 as the DUT reproducing control information in the 
DUT header, a VFRAM parameter that represents 
the number of frames of a video data block to be 
reproduced and the display start frame number of 
an I picture that is a reference screen is provided. 

35 The display start frame number of the I picture is 
used to correct the deviation of the count of the 
reproduced frames due to an occurrence of an 
error. The display start frame number will be de- 
scribed later. 

40 As described above, the sub-picture data has 
the non-interleave mode and the interleave mode 
shown in Figs. 10 to 12. In the interleave mode, 
since sub-picture data to be reproduced is a sub- 
picture channel that is selected from two succes- 

45 sive DUTs, when the total number of reproducing 
frames and the I picture display start frame number 
are simply added to the DUT header, the reproduc- 
tion of the video data cannot be correctly synchro- 
nized with the reproduction of the sub-picture data. 

so In this embodiment, as shown in Fig. 34, in the 
interleave mode, two successive DUTs are treated 
as one display group. The sum of the total number 
of reproducing frames of each of the two DUTs is 
recorded at the DUT header of each DUT. As the 

55 display start frame number of the I picture, the 
frame number of the I picture that is generated 
from the picture data of the second DUT is re- 
corded. Thus, even if the sub-picture data is in the 
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interleave mode, the reproduction of the video data 
can be correctly synchronized with the reproduc- 
tion of the sub-picture data. 

Next, the construction of a frame number gen- 
erating process block of the SYS-PRO 8 that is 
supplied to the sub-picture reproducing portion will 
be described. Fig. 35 is a block diagram showing 
the construction of the frame number generating 
process block. Fig. 36 is a block diagram showing 
the construction of a sub-picture reproducing por- 
tion of the process block. Fig. 37 is a flow chart 
showing the process sequence of the sub-picture 
image reproducing portion. 

DUT data is input to the SYS-PRO portion 8 
through a drive l/F portion 102. A DUT data counter 
104 counts the number of DUTs being input. The 
count value is sent to a comparator 106. The 
comparator 106 compares the count value with the 
start address value of the VFRAME parameter of 
the DUT header stored in a register 105. When 
they match, the comparator 106 sends a load sig- 
nal to a register 103 so as to retrieve the total 
number of reproduced frames (fifth to 0-th bits) and 
the display start frame number (seventh and sixth 
bits) of the I picture of the VFRAME parameter 
from the DUT data. The total number of repro- 
duced frames (fifth to 0-th bits) are sent to a 
comparator 108 and the I picture display start 
frame number (seventh and sixth bits) are sent to a 
comparator 109. 

On the other hand, the frame number counter 
portion 107 counts the frame number of the main 
picture that is being reproduced corresponding to 
the VSYNC signal (vertical synchronous signal) and 
the reproducing start signal that are received from 
the main picture decoder portion. The value of the 
frame number is supplied to a sub-picture repro- 
ducing portion 110 and the comparators 108 and 
109. 

The comparator 108 compares the total num- 
ber of reproduced frames (fifth to 0-th bits) with the 
reproduced frame number of the main picture. 
When they match, the process block resets the 
frame number counter portion 107 and restarts 
counting the reproduced frame number. 

Thus, even if the total number of frames of the 
main picture is variable, the correct reproduced 
frame number is supplied to the sub-picture re- 
producing portion 110. 

However, in such a method, the reproduced 
frame number of the main picture may deviate due 
to an occurrence of an error. To prevent that, in 
this embodiment, the reproduced frame number is 
corrected in the following manner. 

In other words, the comparator 109 compares 
the display start frame number (seventh and sixth 
bits) of the I picture contained in the VFRAME 
parameter with the reproduced frame number. The 



comparison is performed when the I frame detect- 
ing signal (that is output when the main picture 
decoder determines that the I picture frames have 
been reproduced) is input. When there is a dif- 

5 ference between these values, the reproduced 
frame number obtained by the frame number coun- 
ter portion 107 deviates from the correct value for 
the difference. The difference is supplied to the 
r sub-picture reproducing portion 110. The sub-pic- 

10 ture reproducing portion 110 performs different 
processes depending to the difference between the 
reproduced frame number (hereinafter referred to 
as K) and the I picture display start frame number 
(hereinafter referred to as J). The reproduced 

75 frame number K is a frame number of which the I 
picture is reproduced. The I picture display start 
frame number J is a real frame number of which 
the I picture is reproduced. 

When K = J, since the reproduced frame 

20 number has no deviation, no special process is 
performed. 

When K > J, as shown in Figs. 36 and 37, the 
difference between K and J is set to a frame 
number difference counter portion 1 12 (at step S1). 

25 The sub-picture reproducing portion 110 causes a 
sub-picture data switching portion 116 to select 
sub-picture data of one frame prior that is stored in 
a reproduction process data storing portion 115 
and to input it to a sub-picture decoder portion 116 

30 (at step S2). The sub-picture data switching portion 
116 switches the data input to the sub-picture 
decoder portion 14 from the sub-picture data of the 
present frame stored in the buffer memory 117 to 
the sub-picture data of one frame prior stored in 

35 the reproduction process data storing portion 115. 
When the difference between K and J is stored in 
the frame number difference counter portion 112, 
the data input to the sub-picture decoder portion 
114 is switched from the buffer memory 117 to the 

40 reproduction process data storing portion 115. At 
this point, a count stop signal generating portion 
113 generates a count stop signal and outputs it to 
the frame number counter portion 107. Thus, the 
frame number counter portion 107 stops the count- 

45 ing operation (at step S3). 

Thereafter, the frame number difference coun- 
ter portion 112 counts down to 0 at intervals of 
frame display (at step S4). When the count value 
becomes 0 (at step S5), the frame number dif- 

50 ference counter portion 112 causes the sub-picture 
data switching portion 116 to switch the data input 
from the sub-picture decoder portion 14 to the 
buffer memory 117 (at step S6). Thus, the picture 
data can be reproduced for the frames of the 

55 difference between K and J. 

Fig. 38 is a block diagram showing the con- 
struction of a sub-picture process portion of a 
frame number generating process block according 

14 
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to another embodiment of the present invention. 
Fig. 39 is a flow chart showing the process se- 
quence of the sub-picture process portion of Fig. 
38. 

In this embodiment, decoded sub-picture data 5 
of one frame prior is stored in the reproduction 
frame data storing portion 123. 

When K > J, the sub-picture reproducing por- 
tion 210 sets the difference between K and J to a 
frame number difference counter portion 119 (at 10 
step S7). Thereafter, the sub-picture reproducing 
portion 210 causes a sub-picture data output 
switching portion 124 to select decoded sub-pic- 
ture data of one frame prior that is stored in a 
reproduction frame data storing portion 123 and to 75 
output it (at step S8). The sub-picture data output 
switching portion 124 switches the output of the 
sub-picture from the decoded sub-picture data of 
the present frame received from the sub-picture 
decoder portion 122 to the decoded sub-picture 20 
data of one frame prior stored in the reproduction 
frame data storing portion 123. Thus, when the 
difference between K and J is stored in the frame 
number difference counter portion 119, the picture 
output is switched from the decoded sub-picture 25 
data of the present frame received from the sub- 
picture decoder portion 122 to the decoded sub- 
picture data of one frame prior stored in the re- 
production frame data storing portion 123. At this 
point, the count stop signal generating portion 120 30 
generates a count stop signal and outputs it to the 
frame number counter portion 107. Thus, the frame 
number counter portion 107 stops the counting 
operation (at step S9). Consequently, the picture 
being reproduced can be displayed for frames of 35 
the difference between K and J. 

Thereafter, the frame number difference coun- 
ter portion 112 counts down to 0 at intervals of 
frame display (at step S10). When the count value 
becomes 0 (at step S11), the frame number dif- 40 
ference counter portion 119 causes the sub-picture 
data output switching portion 124 to switch the sub- 
picture output to the decoded sub-picture data of 
the present frame received from the sub-picture 
decoder portion 122 (at step S12). 45 

Fig. 40 is a block diagram showing the con- 
struction of a process block of the picture re- 
producing portion in the case that the comparator 
109 of the frame number generating process block 
outputs a compared result of K < J. Fig. 41 is a so 
flow chart showing the process sequence of the 
block of Fig. 40. 

When K < J, the difference between the value 
of a reproduced frame number (K) of the I picture 
and the value of a display start frame number (J) of 55 
the I picture and the value of a reproduced frame 
number are sent to the reproduction process de- 
tecting portion 126 (at step S13). Thereafter, the 



reproduction process detecting portion 126 deter- 
mines whether or not sub-picture data has been 
reproduced for frames K to J corresponding to pre- 
decoded sub-picture data stored in the buffer 
memory portion 128 (at steps S14 and S15). If the 
reproducing control has been performed, the re- 
production process detecting portion 126 controls 
the sub-picture decoder porion 129 so as to for- 
cedly reproduce sub-picture of a frame most close 
to the frame number of a main picture being repro- 
duced (at step S16). Thereafter, the load sinal 
generating portion 130 generates a load signal so 
as to load the display start frame number (J) of the 
I picture to the frame number counter portion 107 
(at step S17). Thus, the display of the frame num- 
ber K is branched to the display , of the frame 
number J. 

As described above, according to the present 
invention, a plurality of data blocks such as main 
picture, sound, sub-picture, and so forth are treated 
as one data unit. In particular, even if sound data 
and sub-picture data are set for a plurality of chan- 
nels or a plurality of streams, they can be precisely 
and stably divided corresponding to a block header 
in the data blocks. 

In addition, according to the present invention, 
a plurality of data blocks such as main picture, 
sound, and sub-picture are treated as one data unit 
that is synchronously reproduced. In particular, 
even if the number of display frames of the data 
unit of the main picture is variable, each data block 
can be precisely and stably synchronized at inter- 
vals of the frame display of the main picture. 

Although the present invention has been shown 
and described with respect to a best mode em- 
bodiment thereof, it should be understood by those 
skilled in the art that the foregoing and various 
other changes, omissions, and additions in the form 
and detail thereof may be made therein without 
departing from the spirit and scope of the present 
invention. 

Claims 

1. A method for constructing a data unit having a 
plurality of types of data blocks, the data unit 
comprising: 

a unit header disposed at the beginning of 
the data unit and adapted for controlling each 
of the data blocks as independent data of the 
data unit; and 

a block header disposed at the beginning 
of at least one of the data blocks and adapted 
for controlling data of the data block. 

2. The method as set forth in claim 1 , 

wherein at least one of the data blocks is 
divided into a plurality of groups of data, and 



15 



27 



EP 0 677 961 A2 



28 



wherein the block header of the data block 
has control information that represents divided 
positions of the groups of data of the data 
blocks. 

5 

3. A reproducing apparatus for reproducing a 
data unit having a plurality of types of data 
blocks, the apparatus comprising: 

input means for inputting the data unit; 

data unit dividing means for dividing the 10 
data unit into data blocks corresponding to a 
unit header disposed at the data unit that is 
input by said input means; 

data block dividing means for dividing the 
data block into groups of data corresponding is 
to the block header when the block header is 
disposed at the divided data blocks; and 

reproducing control means for reproducing 
only a predetermined one of the groups di- 
vided by said data block dividing means. 20 

4. A method for reproducing a data unit having a 
plurality of types of data blocks, comprising 
the steps of: 

inputting the data unit; 25 

dividing the data unit into data blocks cor- 
responding to a unit header disposed at the 
data unit that is input by said input means; 

dividing the data block into groups of data 
corresponding to the block header when the 30 
block header is disposed at the divided data 
blocks; and 

reproducing only a predetermined one of 
the groups divided by said data block dividing 
means. 35 

5. A method for constructing a data unit having a 
plurality of types of data blocks, the data unit 
having a block length equivalent to a predeter- 
mined reproducing time period that is variable 40 
in a predetermined range, the data unit com- 
prising: 

a unit header disposed at the beginning of 
the data unit and adapted for controlling each 
of the data blocks as independent data of the 45 
data unit; 

a main picture data block having picture 
stream data with the block length of the re- 
producing time period and a main picture 
block header that represents an effective block so 
length of the picture stream data and the start 
position of the picture stream data of main 
picture data block; 

a sound data block having at least one 
sound stream data with the block length of the 55 
reproducing time period and a sound block 
header that represents the effective block 
length of the sound stream data and the start 



position of the sound stream data of the sound 
data block; and 

a sub-picture data block having at least 
one sub-picture channel data with the block 
length of the reproducing time period and a 
sub-picture block header that represents the 
effective data length of the sub-picture channel 
data and the start position of the sub-picture 
channel data block of the sub-picture block 
data. 

6. The method as set forth in claim 5, 

wherein the sound data block and the sub- 
picture data block are adjacently disposed, the 
effective block length thereof being fixed, the 
boundary of the sound data block and the sub- 
picture data block being variable in the range 
of the effective block length. 

7. The method as set forth in claim 5, 

wherein the data blocks of the data unit 
that are processed chronologically independent 
from other data blocks and disposed at pre- 
determined intervals are disposed in a plurality 
of data units so as to process a set of the data 
blocks as one data block, and 

wherein the unit header of the data units 
has information that identifies the position of 
the data blocks of a predetermined data unit in 
the set of the data blocks. 

8. The method as set forth in claim 5, 

wherein the sound block header of the 
sound data block further includes stream posi- 
tion information and stream construction in- 
formation, the stream position information be- 
ing adapted for identifying the start point, size, 
and presence/absence of the sound stream 
data, the stream construction information being 
adapted for identifying the construction of 
sound stream data. 

9. The method as set forth in claim 9, 

wherein the sound stream data is a set of 
a plurality of frame data divided by a predeter- 
mined time unit, and 

wherein the stream construction informa- 
tion includes information that represents 
whether or not the pattern of each of the frame 
data of the sound stream data is the same. 

10. The method as set forth in claim 5, 

wherein the sub-picture block header of 
the sub-picture data block further includes 
channel position information and channel dis- 
play control information, the channel position 
information is adapted for representing the 
start point, size, and presence/absence of each 
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of the sub picture channel data, the channel 
display control information being adapted for 
identifying the display control state of each of 
the sub-picture channel data. 

11. The method as set forth in claim 10, 

wherein the sub-picture channel display 
control information is adapted for identifying 
each of sub-picture channel data as the follow- 
ing display control modes: 

an immediate display mode for displaying 
the sub-picture channel data of a particular 
data unit in the time period of the data unit; 

a data hold mode for displaying the sub- 
picture channel data of a particular data unit in 
the time period of another data unit with a 
designated start time; 

a hold data display mode for issuing in- 
formation of the start of the display of the sub- 
picture channel data being held; and 

a display clear mode for issuing informa- 
tion of the clear of the sub-picture channel 
data being displayed. 

12. The method as set forth in claim 5, 

wherein the unit header has identification 
information of a predetermined data unit, the 
identification information comprising: 

a program number that represents a pro- 
gram of the predetermined data unit in a set of 
data units; 

a data unit number that represents a re- 
production start time of the predetermined data 
unit in the program; and 

information that represents a physical start 
address of the predetermined data unit and a 
physical start address of another data unit 
spaced apart therefrom by ± n. 

13b The method as set forth in claim 12, 

wherein the physical start address of the 
other data unit spaced apart from the predeter- 
mined data unit by ± n is represented by a 
relative sector number measured from the pre- 
determined data unit or by a relative sector 
number measured from a boundary when the 
other data unit is not present in the boundary 
of the program. 

14. The method as set forth in claim 5, 

wherein the unit header has reproducing 
control information necessary for reproducing a 
predetermined data unit, the reproducing con- 
trol information including a program number of 
a program that can be reproduced as a next 
program. 



15. The method as set forth in claim 5, 

wherein the unit header has reproducing 
control information necessary for reproducing a 
predetermined data unit, the reproducing con- 
5 trol information including an effect setting flag 

for providing an effect to picture data and 
sound data of the data unit. 

16. The method as set forth in claim 5, 

w wherein the picture stream data of the 

main picture data block is composed of a 
group of a predetermined number of pictures 
compressed corresponding to MPEG system, 
the unit header further including the total num- 

15 ber of frames of the main picture data block 

being reproduced and information that repre- 
sents a display start frame number of a refer- 
ence screen of the picture data. 

20 17. The method as set forth in claim 5, 

wherein the sub-picture data blocks are 
disposed in N data units (where N is any 
integer that is equal to or larger than 2), the 
unit header further including information that 

25 represents the total number of frames of the N 
data units of the main picture data blocks 
being reproduced and a display start frame 
number of a reference screen in the last one of 
the N data units. 

30 

18. A reproducing apparatus for reproducing a 
data unit having a plurality of types of data 
blocks, comprising: 

frame number counting means for count- 

35 ing a reproduced frame number of a main 

picture corresponding to a reproduced output 
signal of the main picture; 

reproducing process means for inputting 
the reproduced frame number that is output 

40 from said frame number counting means and 

reproducing sound data or sub-picture data in 
synchronization with the reproduction of the 
main picture corresponding to the reproduced 
frame number; 

45 first comparing means for comparing the 

reproduced frame number obtained by said 
frame number counting means with the total 
number of frames of the main picture data 
block read from a unit header and resetting 

so said frame number counting means when the 

reproduced frame number and the total num- 
ber of frames match; 

reference screen detecting means for de- 
tecting the start of the reproduction of the 

55 reference screen corresponding to the repro- 

duced data of the main picture; 

second comparing means for comparing 
the reproduced frame number obtained by said 

17 
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frame number counting means with a display 
start frame number of the reference screen 
that is read from the unit header when the start 
of the reproduction of the reference screen is 
detected by said reference screen detecting 
means; 

down-counting means for counting down 
the difference between the reproduced frame 
number and the display start frame number of 
the reference screen at intervals of the frame 
display when the reproduced frame number is 
larger than the display start frame number of 
the reference screen; 

storing means for storing reproduced data 
of a sub-picture of one frame prior; 

switching means for switching reproduced 
data between sub-picture of one frame prior 
stored in said storing means and sub-picture of 
the present frame; and 

means for controlling said switching means 
to select the reproduced data of the sub-pic- 
ture stored in said storing means and stop the 
counting operation of said frame number 
counting means when the difference held by 
said down-counting means is other than 0. 

19. The reproducing apparatus as set forth in 
claim 18, 

wherein said reproducing process means 
comprises: 

decoding means for decoding sound data 
or sub-picture data and obtaining a sound out- 
put or a sub-picture output; and 

buffer means for storing pre-decoded sub- 
picture data of the present frame, 

wherein said storing means is adapted for 
storing pre-decoded sub-picture data of one 
frame prior, and 

wherein said switching means is adapted 
for selecting sub-picture data stored in said 
storing means and outputting the selected sub- 
picture data to said decoding means when the 
difference counted by said down-counting 
means is other than 0 and for selecting sub- 
picture data of the present frame and output- 
ting the selected data to said decoding means 
when the difference counted by said down- 
counting means is 0. 

20. The reproducing apparatus as set forth in 
claim 18, 

wherein said reproducing process means 
has decoding means for decoding sound data 
or sub-picture data and outputting decoded 
sound or decoded sub-picture, 

wherein said storing means is adapted for 
storing reproduced sub-picture data of one 
frame prior obtained by said decoding means, 



and 

wherein said switching means is adapted 
for selecting sub-picture data stored in said 
storing means and outputting the selected sub- 

5 picture data when the difference counted by 

said down-counting means is other than 0 and 
for selecting sub-picture data of the present 
frame that is output from said decoding means 
and outputting the selected data when the dif- 

w ference counted by said down-counting means 

is 0. 

21. The reproducing apparatus as set forth in 
claim 18, the apparatus further comprising: 

75 reproduction controlling process means for 

determining whether or not a sub-picture re- 
production controlling process is present be- 
tween a reproducing start frame of the refer- 
ence screen and a reproduced frame obtained 

20 by said frame number counting means when 

the display start frame number of the reference 
screen is larger than the reproduced frame 
obtained by said frame number counting 
means corresponding to the compared result 

25 of said second comparing means; 

reproducing process forcing means for for- 
cedly performing the reproducing control pro- 
cess when it is determined that there is the 
reproduced control process; and 

30 setting the reproduced start frame number 

of the reference screen to said frame number 
counting means after said reproducing control 
process is completed. 
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